Dynamic media content for in-store screen experiences

ABSTRACT

Systems, methods, and computer program products for performing an operation comprising detecting a first mobile device within a predefined proximity of a display device, receiving profile data from the first mobile device, identifying at least one rule for selecting media content based on the profile data, selecting, based on the at least one rule applied to the profile data, a first item of media content of a plurality of items of media content, and outputting the first item of media content for display on the display device.

BACKGROUND Field of the Invention

The present disclosure relates to in-store screen experiences, and morespecifically, to dynamically selecting media content for in-store screenexperiences.

Description of the Related Art

It is a challenge to engage visitors to retail establishments, asthousands of people may visit a given location every day. For example, avideo for a specific toy may engage some users, but many others may notbe interested in that particular item. Often, more tailored content isthe only way to engage specific users or groups of users. Therefore,there is a need for solutions that engage as many users as possible.

SUMMARY

In one embodiment, a method comprises detecting a first mobile devicewithin a predefined proximity of a display device, receiving profiledata from the first mobile device, identifying at least one rule forselecting media content based on the profile data, selecting, based onthe at least one rule applied to the profile data, a first item of mediacontent of a plurality of items of media content, and outputting thefirst item of media content for display on the display device.

In another embodiment, a computer program product comprises anon-transitory computer-readable storage medium having computer-readableprogram code embodied therewith, the computer-readable program codeexecutable by a processor to perform an operation comprising detecting afirst mobile device within a predefined proximity of a display device,receiving profile data from the first mobile device, identifying atleast one rule for selecting media content based on the profile data,selecting, based on the at least one rule applied to the profile data, afirst item of media content of a plurality of items of media content,and outputting the first item of media content for display on thedisplay device.

In another embodiment, a system comprise one or more computer processorsand a memory containing a program which when executed by the processorsperforms an operation, the operation comprising detecting a first mobiledevice within a predefined proximity of a display device, receivingprofile data from the first mobile device, identifying at least one rulefor selecting media content based on the profile data, selecting, basedon the at least one rule applied to the profile data, a first item ofmedia content of a plurality of items of media content, and outputtingthe first item of media content for display on the display device.

BRIEF DESCRIPTION OF THE DRAWINGS

So that the manner in which the above recited aspects are attained andcan be understood in detail, a more particular description ofembodiments of the disclosure, briefly summarized above, may be had byreference to the appended drawings.

It is to be noted, however, that the appended drawings illustrate onlytypical embodiments of this disclosure and are therefore not to beconsidered limiting of its scope, for the disclosure may admit to otherequally effective embodiments.

FIG. 1 illustrates a system architecture which provides dynamic mediacontent for in-store experiences, according to one embodiment.

FIGS. 2A-2E illustrate examples of dynamic media content for in-storeexperiences, according to various embodiments.

FIG. 3 is a flow chart illustrating a method for providing dynamic mediacontent for in-store experiences, according to one embodiment.

FIG. 4 is a flow chart illustrating a method to select items of mediacontent, according to one embodiment.

FIG. 5 is a flow chart illustrating a method to modify items of mediacontent, according to one embodiment.

FIG. 6 is a block diagram illustrating a system which provides dynamicmedia content for in-store experiences, according to one embodiment.

DETAILED DESCRIPTION

Embodiments disclosed herein provide techniques to dynamically selectrelevant media content for outputting in retail establishments.Generally, embodiments disclosed herein leverage one or more of userrecognition, device recognition, object recognition, user profiles,biometric data, user-generated media content, live media content, andstored media content to dynamically select media content that is mostrelevant to one or more users in the retail establishment. For example,embodiments disclosed herein may determine that a customer in a retailstore is browsing items related to a specific character. As such,embodiments disclosed herein may identify a video of the character, anddynamically select the video for outputting on a display in the store.Furthermore, embodiments disclosed herein may modify and/or enhance thevideo with user-specific features. For example, embodiments disclosedherein may add an image of the user to the video, giving the appearancethat the user is in the video with their favorite character. As anotherexample, the modified video may depict the user wearing clothingassociated with the character.

FIG. 1 illustrates a system architecture 100 which provides dynamicmedia content for in-store experiences, according to one embodiment. Asshown, the system 100 includes a server 101, a plurality of user devices102, a plurality of remote data sources 103, a plurality of cameras 104,and one or more display devices 105 communicably coupled via a network130. As shown, the server 101 includes a media manager 106, a data storeof stored media 107, a data store of rules 108, and a plurality of userprofiles 110. The media manager 106 is an application configured todynamically select relevant media content and output the on one or moreoutput devices, such as the display devices 105. The stored media 107includes videos, images, and audio files. In some embodiments, thestored media 107 includes user-submitted media content that has beenapproved for display based on one or more rules in the rules 108. Therules 108 include rules for selecting, modifying, approving, andoutputting relevant media content on the display devices 105. The userprofiles 110 include profile data for a plurality of users, which mayreflect user preferences, avatars, account information for variousapplications and/or services, and the like.

As shown, the user devices 102 include an instance of the stored media107, a plurality of applications 109, user profiles 110, and a pluralityof biometric sensors 111. Generally, the user devices 102 arerepresentative of any type of computing device, such as a smartphone,tablet, portable gaming device, wearable computing device, and the like.The stored media 107 on the user devices 102 includes media capturedand/or stored by the user (not pictured) on the respective user device102. The applications 109 are representative of any type of application,such as video games, social media applications, shopping applications,loyalty applications, and the like. The instance of the user profiles110 on the user devices 102 store user profile data for one or moreusers, including profile data for the applications 109. The biometricsensors 111 are representative of any type of sensor which monitors abiometric attribute of the user, such as heartrate sensors, bloodpressure sensors, temperature sensors, perspiration sensors, and thelike.

The remote data sources 103 are representative of any type of datasource, such as social media platforms, networked audio/video sources,media hosting services, web services, and the like. As shown, the remotedata sources 103 include an instance of stored media 107 and one or moresources of live media 113. The live media 113 is representative of anymultimedia content broadcasted in real time, such as a live video feedof a theme park.

In at least one embodiment, the cameras 104 and the display devices 105are located in a retail establishment. The cameras 104 arerepresentative of any type of imaging device, including image capturedevices, devices that can detect objects, and/or devices that can sensemovement. In at least one embodiment, the cameras 104 includemicrophones (not pictured) that capture audio. The display devices 105are representative of any type of display device, such as a monitor,projection screen, television, and the like. In at least one embodiment,the display devices 105 are three-dimensional (3D) devices configured tooutput stereoscopic images, such that the output appears to be in threedimensions from the perspective of the user (e.g., while the user iswearing 3D glasses).

As stated, the media manager 106 dynamically selects media content tooutput on the display devices 105 of a given retail establishment.Generally, the media manager 106 may detect the presence of one or moreuser devices 102 in the retail establishment (e.g., via wirelesssignals, facial recognition, and the like). The media manager 106 mayidentify user devices 102 that of users have previously agreed toparticipate in sharing information with the media manager 106. The mediamanager 106 may then receive data describing the user of the userdevices 102, such as the profile data in the user profiles 110, datafrom the applications 109, and data from the biometric sensors 111. Inresponse, the media manager 106 is able to tailor multimedia content toone or more of the detected users. For example, a rule in the rules 108may include an indication that user X has scheduled the playback of avideo for user Y at a predefined time. If the media manager 106 detectsthe presence of user X and/or user Y (and/or the user devices 102 ofusers X and/or Y), the media manager 106 may output the video on one ormore display devices 105 at the predefined time. The video may be storedin any instance of the stored media 107 (e.g., submitted by users X, Y)and/or received from the remote data sources 103 (e.g., a live videofrom the user Y′s favorite attraction at a theme park). Furthermore, themedia manager 106 may modify the content outputted on the displaydevices 105. For example, the media manager 106 may overlay an image ofuser Y on the video, output a live video of user Y in the store in asplit-screen arrangement on the display device 105, add clothing orother objects to an image and/or video of user Y, and the like.Furthermore, the media manager 106 may enrich the user profile 110 ofone or more users. For example, if user Y purchases a hat in the retailestablishment, the media manager 106 may add the hat to the clothing ofuser Y's avatar for a gaming application 109, and update the userprofile 110 for the avatar accordingly.

FIG. 2A illustrates an example of dynamic media content outputted on adisplay device 105 for in-store experiences, according to oneembodiment. As shown, the three users 201-203 are depicted asparticipating in a birthday party at a retail establishment includingthe display device 105. The media manager 106 may detect the users201-203 (e.g., via a device 102, facial recognition, etc.), and causeone or more of the cameras 104 to capture video of the birthday party inthe store. The media manager 106 may then output the video captured bythe cameras 104 as the video 210 on the display 105. As shown, the mediamanager 106 has also overlaid a text greeting of “happy birthday” on thevideo 210 of the birthday party. Furthermore, the media manager 106 hasselected a video 211 to output on the display 105 with the video 210 ofthe birthday party. In this example, the video 211 is a live video fromone of the remote data sources 103, which corresponds to a favoriteattraction of one of the users 201-203. The favorite attraction may bestored as a setting in the corresponding user profile 110, allowing themedia manager 106 to identify the most appropriate content to displayfor the users 201-203. As the video 211 continues to play, the video 210includes the reactions of the users 201-203 to the video 211. As such,the media manager 106 may save a copy of the video 210 for later use.

FIG. 2B illustrates an example of dynamic media content outputted on adisplay device 105 for in-store experiences, according to oneembodiment. As shown, a user 204 is interacting with a tennis racket 205in a retail store. The cameras 104 (not pictured) may capture video ofthe user 204 interacting with the tennis racket 205. As such, the mediamanager 106 may analyze the image data provided by the camera 104 toidentify the user 204 (e.g., via facial recognition) and the tennisracket 205 (e.g., via object recognition). The media manager 106 mayfurther detect a user device 102 of the user 204, and receive userprofile data 110 and biometric data captured by the biometric sensors111 from the user device 102. The user profile data may specify that theuser 204 is a fan of tennis, and the data provided by the biometricsensors 111 may reflect that the user 204 is excited while holding thetennis racket 205.

Based on the received data and/or one or more rules 108, the mediamanager 106 may output a video 220 of the user 204 which depicts theuser 204 holding a tennis racket 211, which may be a digitized versionof the tennis racket 205. The media manager 106 may further outputsounds associated with tennis, such as sounds from a tennis match, whilethe video 220 of the user 204 is outputted on the display 105.Furthermore, the media manager 106 may leverage motion detection totrack the real-life movements of the user 204 in the retail store. Indoing so, the user 204 depicted in the video 220 mimics the detectedreal-life motions of the user 204, further engaging the user.

FIG. 2C illustrates an example of dynamic media content outputted on adisplay device 105 for in-store experiences, according to oneembodiment. FIG. 2C depicts an embodiment where a digital version 231(e.g., a computer-generated version) of the user 204 of FIG. 2B iscreated and outputted as part of a video 230 on the display 105. Again,the media manager 106 may detect the motions of the user 204, and causethe digital version 231 of the user in the video 230 to mimic thereal-life motions of the user 204. Furthermore, as shown, the mediamanager 106 depicts the digital version 231 of the user 204 as holdingthe computer-generated tennis racket 211. Further still, as shown, themedia manager 106 outputs a second video 232, which includes an avatar233 of the user. The avatar 233 may be retrieved from the user's accountfor a given application 109 (e.g., in the profile data 110). As shown,the avatar 233 is also depicted as holding the tennis racket 211. In atleast one embodiment, the media manager 106 modifies the user profile110 to depict that the avatar now is equipped with the tennis racket211.

FIG. 2D illustrates an example of dynamic media content outputted on adisplay device 105 for in-store experiences, according to oneembodiment. As shown, an avatar 234 of a user detected in proximity ofthe display 105 is outputted in a first panel 240 on the display device105. The avatar 234 may be retrieved from the user profile 110 of theuser, or any other source. In at least one embodiment, the media manager106 may modify the avatar 234. For example, the media manager 106 maymodify the avatar 234 to look more like the user 204. To do so, themedia manager 106 may compare a captured image of the user 204, identifyone or more visual features of the user, and modify the avatar 233 basedon the identified features to create the modified avatar 235. The mediamanager 106 may then output the modified avatar 235 in video panel 241.As shown, the media manager 106 has further enhanced the modified avatar235 by depicting the avatar 241 as holding an example object 236. In atleast one embodiment, the example object 236 corresponds to an objectthe user has purchased or has otherwise interacted with in the retailstore. In at least one embodiment, the media manager 106 stores themodified avatar 235 in the user profile 110 of the user.

FIG. 2E illustrates an example of dynamic media content outputted on adisplay device 105 for in-store experiences, according to oneembodiment. As shown, the display 105 outputs a video 251 which depictsthree users 206-208 attending a birthday party at home. The video 251may be a video from the remote data sources 103, e.g., pre-recordedvideo of the birthday party including the users 206-208. As part ofenhancing the user experience, the media manager 106 may overlay amessage 252 on the video 251. In at least one embodiment, message 252 isa “hidden” message in that the message 252 appears for a very limitedtime (e.g., a single frame of video). To allow the user to capture theirspecial moment in the retail store, the media manager 106 maycommunicate with the user device 102 of one or more users, allowing acamera of the user device 102 to capture an image of the display 105that includes the hidden message 252. To do so, in one embodiment, themedia manager 106 may provide the user device 102 with an indication ofa time when the hidden message 252 will be displayed. The camera of theuser device 102 may then capture the image at the specified time, andstore the image in the stored media 107. As another example, the mediamanager 106 may provide the user device 102 with polarization or colorparameters associated with the hidden message 252. The user device 102may then modify parameters of the camera (e.g., polarization and/orcolor parameters) to capture an image and/or video that visibly includesthe hidden message 252.

As previously indicated, the cameras 104 may continue to capture imagesand/or video of the users in the retail store. Therefore, the mediamanager 106 may create a new video, which includes the pre-recordedvideo 251 (e.g., of the birthday party) as well as the video captured bythe cameras 104, which depicts the users watching the pre-recorded video251 in the retail store.

FIG. 3 is a flow chart illustrating a method 300 for providing dynamicmedia content for in-store experiences, according to one embodiment. Asshown, the method 300 begins at block 310, where one or more rules inthe rules 108 are defined. As previously indicated, the rules 108include predefined and/or user-defined rules related to selecting,modifying, and outputting content on the display devices 105. Therefore,for example, a system administrator may define a rule specifying tooutput video of a user's favorite cartoon character when the user'spulse rate is below a specified threshold. At block 320, the mediamanager 106 identifies users and/or objects in proximity of a displaydevice 105. For example, using wireless communications, the mediamanager 106 may identify the smartphone 102 of a user. As anotherexample, the media manager 106 may perform facial recognition on animage of the user captured by the cameras 104 to identify the user.Similarly, the media manager 106 may use object recognition technologyto identify an object held by the user (or an object in proximity of theuser), such as a toy doll being sold in the retail store.

At block 330, the media manager 106 identifies rules in the rules 108selecting media content to output on the display device 105. Generally,the media manager 106 considers attributes in the user profile 110 ofthe user (e.g., preferences), biometric data received from the userdevice 102 of the user, and the identified objects in proximity of theuser when identifying the relevant rules 108. The media manager 106 mayalso consider schedules of events, e.g., a local birthday party, remoteparade, sporting events, concerts, and the like. At block 340, the mediamanager 106 selects at least one item of media content based on the datareceived from the user device 102, the user profile data 110, and therules identified at block 330. For example, if the media manager 106detects the user holding the toy doll, the media manager 106 may selecta video including the character associated with the toy doll. The mediamanager 106 may also select the video based on the user profile 110 ofthe detected user specifying the character is the user's favoritecharacter. As previously indicated, the content may be user-provided,stored locally, and or received from the remote data sources 103 (e.g.,a live video).

At block 350, the media manager 106 outputs the items of media contentselected at block 340. Generally, the media manager 106 outputs images,video, and/or audio selected at block 340. At block 360, described ingreater detail with reference to FIG. 5, the media manager 106optionally modifies the items of media content outputted at block 350.For example, the media manager 106 may overlay a message to the user,output an image and/or video of the user captured by the cameras 104,add an additional media source (e.g., a live video from the remote datasources 103), and the like. More generally, the media manager 106continuously monitors users and/or devices in proximity of each displaydevice 105 in the retail store. Doing so allows the media manager 106 toidentify relevant media content to output on the display devices 105.

FIG. 4 is a flow chart illustrating a method 400 corresponding to block340 to select items of media content, according to one embodiment. Asshown, the method 400 begins at block 410, where the media manager 106identifies users and/or user devices 102 proximate to a given displaydevice 105. As previously indicated, the media manager 106 uses wirelessdata communications to identify user devices 102. The media manager 106may use facial recognition algorithms applied to image data captured bythe cameras 104 to identify users. Additionally and/or alternatively,the media manager 106 may identify users based on the user profile datareceived from the user devices 110 (e.g., by identifying accountinformation for the user). At block 420, the media manager 106 receivesdata from the user device 102 and/or the instance of the user profiles110 stored in the server 101. Generally, the received data includesbiometric data from the biometric sensors 111, user profile data, datadescribing the applications 109 on the user devices 102, media content(e.g., from the user devices 102 and/or the remote data sources 103),and any other type of user data.

At block 430, the media manager 106 optionally receives schedulinginformation, such as scheduled parties in the retail store, as well asremote events for which the data sources 103 provide media content(e.g., video conferenced birthday parties). At block 440, the mediamanager 106 optionally identifies objects possessed by the users withinproximity of the display devices 105. For example, a user may be wearinga t-shirt and helmet that are for sale in the retail establishment. Themedia manager 106 may generally use image data provided by the cameras104 to perform object recognition to identify the objects. At block 450,the media manager 106 references the rules 108 for selecting content.Generally, the rules 108 may include associations between one or more ofuser profile parameters, biometric data, event scheduling, detectedevent types (both in-store and remote), and a type of media content(e.g., a birthday-themed video for a birthday party).

At block 460, the media manager 106 identifies a plurality of candidateitems of media content from local and/or remote sources based on theidentified rules. For example, the media manager 106 may identifymetadata of videos, images, and/or songs in the stored media 107 and/orremote data sources 103 indicating that the videos, images, and/or songsare related to birthdays. At block 470, the media manager 106 optionallycomputes a score for each candidate item of media content identified atblock 460. Generally, the media manager 106 may use any suitable scoringalgorithm to compute a score for each candidate item of media content,where the score reflects a relevance in light of the users in the store,the events occurring in the store (and/or remotely), the userpreferences, and any other type of user data. At block 480, the mediamanager 106 selects and returns at least one item of media content.

FIG. 5 is a flow chart illustrating a method 500 corresponding to block360 to modify items of media content, according to one embodiment. Asshown, the method 500 begins at block 510, where the media manager 106optionally inserts hidden information in media content outputted on thedisplay 105. For example, the media manager 106 may overlay the birthdaymessage 252 on the video 251 of FIG. 2E. The media manager 106 may thencommunicate with the user devices 102 of each associated user to allowthe user device 102 to capture an image of the hidden message. At block520, the media manager 106 optionally generates a graphicalrepresentation of a user and/or an object possessed by the user. Forexample, the media manager 106 may render an animated version of theuser and any objects the user is holding. The media manager 106 may thenoutput the animated version of the user and objects on the display 105.

At block 530, the media manager 106 may optionally associate objectswith the user profile 110 of a user. For example, the media manager 106may associate the user with the game of basketball based on the userpurchasing a basketball in the retail store. At block 540, the mediamanager 106 may optionally modify the avatar of the user based on thegraphical representation of the user generated at block 520. Doing socreates a “look alike” version of the avatar for the user. The mediamanager 106 may also modify the avatar of the user based on objects theuser is interacting with in the retail store. For example, if the useris wearing a helmet, the media manager 106 may add a graphicallygenerated version of the helmet to the user's avatar for an application109.

At block 550, the media manager 106 optionally identifies and outputsadditional media content for display. For example, during a birthdayparty, the media manager 106 may identify a video including the user'sfavorite characters singing happy birthday. The media manager 106 maythen output the video on the display 105 during the birthday party. Atblock 560, the media manager 106 may optionally modify a backgroundimage outputted on the display 105. For example, the media manager 106may output an image of a child during the child's birthday party. Atblock 570, the media manager 106 may detect an event, person, and/ortime that is associated with an operation in the rules 108. In response,the media manager 106 performs the predefined operation. For example, ifuser X's birthday party is scheduled for 2:00 PM in the retail store,the media manager 106 may monitor the image data provided by the cameras104 to detect the presence of user X. Once user X arrives, the mediamanager 106 determines to output music and videos to welcome user X totheir birthday party. The media manager 106 may also initiate remotecommunications with other devices. Doing so allows remote users toparticipate in events occurring in the retail store, such as user X'sbirthday party.

FIG. 6 is a block diagram illustrating a system 600 which providesdynamic media content for in-store experiences, according to oneembodiment. The networked system 600 includes the server 101. The server101 may also be connected to other computers such as the user devices102 and the remote data sources 103 via a network 630. In general, thenetwork 630 may be a telecommunications network and/or a wide areanetwork (WAN). In a particular embodiment, the network 630 is theInternet.

The server 101 generally includes a processor 604 which obtainsinstructions and data via a bus 620 from a memory 606 and/or a storage608. The server 101 may also include one or more network interfacedevices 618, input devices 622, and output devices 624 connected to thebus 620. The server 101 is generally under the control of an operatingsystem (not shown). Examples of operating systems include the UNIXoperating system, versions of the Microsoft Windows operating system,and distributions of the Linux operating system. (UNIX is a registeredtrademark of The Open Group in the United States and other countries.Microsoft and Windows are trademarks of Microsoft Corporation in theUnited States, other countries, or both. Linux is a registered trademarkof Linus Torvalds in the United States, other countries, or both.) Moregenerally, any operating system supporting the functions disclosedherein may be used. The processor 604 is a programmable logic devicethat performs instruction, logic, and mathematical processing, and maybe representative of one or more CPUs. The network interface device 618may be any type of network communications device allowing the server 101to communicate with other computers via the network 630.

The storage 608 is representative of hard-disk drives, solid statedrives, flash memory devices, optical media and the like. Generally, thestorage 608 stores application programs and data for use by the server101. In addition, the memory 606 and the storage 608 may be consideredto include memory physically located elsewhere; for example, on anothercomputer coupled to the server 101 via the bus 620.

The input device 622 may be any device for providing input to the server101. For example, a keyboard and/or a mouse may be used. The inputdevice 622 represents a wide variety of input devices, includingkeyboards, mice, controllers, and so on. Furthermore, the input device622 may include a set of buttons, switches or other physical devicemechanisms for controlling the server 101. The output device 624 mayinclude output devices such as monitors, touch screen displays, and soon.

As shown, the memory 606 contains the media manager 106. As shown, thestorage 608 contains the stored media 107, rules 108, and user profiles110. As shown, the user devices 102 also include an instance of anetwork interface 618. The user devices 102 further include a locationmodule 650. The location module 650 corresponds to a module which allowsthe location of a given user device 102 to be determined. One example ofa location module 650 includes a global positioning system (GPS) module.

In the foregoing, reference is made to embodiments of the disclosure.However, it should be understood that the disclosure is not limited tospecific described embodiments. Instead, any combination of the recitedfeatures and elements, whether related to different embodiments or not,is contemplated to implement and practice the disclosure. Furthermore,although embodiments of the disclosure may achieve advantages over otherpossible solutions and/or over the prior art, whether or not aparticular advantage is achieved by a given embodiment is not limitingof the disclosure. Thus, the recited aspects, features, embodiments andadvantages are merely illustrative and are not considered elements orlimitations of the appended claims except where explicitly recited in aclaim(s). Likewise, reference to “the invention” shall not be construedas a generalization of any inventive subject matter disclosed herein andshall not be considered to be an element or limitation of the appendedclaims except where explicitly recited in a claim(s).

As will be appreciated by one skilled in the art, aspects of the presentdisclosure may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present disclosure may take theform of an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present disclosure may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for aspects of thepresent disclosure may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Smalltalk, C++ or the like and conventional proceduralprogramming languages, such as the “C” programming language or similarprogramming languages. The program code may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Aspects of the present disclosure are described below with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of thedisclosure. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

Embodiments of the disclosure may be provided to end users through acloud computing infrastructure. Cloud computing generally refers to theprovision of scalable computing resources as a service over a network.More formally, cloud computing may be defined as a computing capabilitythat provides an abstraction between the computing resource and itsunderlying technical architecture (e.g., servers, storage, networks),enabling convenient, on-demand network access to a shared pool ofconfigurable computing resources that can be rapidly provisioned andreleased with minimal management effort or service provider interaction.Thus, cloud computing allows a user to access virtual computingresources (e.g., storage, data, applications, and even completevirtualized computing systems) in “the cloud,” without regard for theunderlying physical systems (or locations of those systems) used toprovide the computing resources.

Typically, cloud computing resources are provided to a user on apay-per-use basis, where users are charged only for the computingresources actually used (e.g. an amount of storage space consumed by auser or a number of virtualized systems instantiated by the user). Auser can access any of the resources that reside in the cloud at anytime, and from anywhere across the Internet. In context of the presentdisclosure, a user may access applications or related data available inthe cloud. For example, the media manager 106 could execute on acomputing system in the cloud and output relevant media content inretail locations around the world. In such a case, the media manager 106could modify the user profiles and/or avatars of users and store updatedprofiles and avatars at a storage location in the cloud. Doing so allowsa user to access this information from any computing system attached toa network connected to the cloud (e.g., the Internet).

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of the present disclosure. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder or out of order, depending upon the functionality involved. Itwill also be noted that each block of the block diagrams and/orflowchart illustration, and combinations of blocks in the block diagramsand/or flowchart illustration, can be implemented by special purposehardware-based systems that perform the specified functions or acts, orcombinations of special purpose hardware and computer instructions.

While the foregoing is directed to embodiments of the presentdisclosure, other and further embodiments of the disclosure may bedevised without departing from the basic scope thereof, and the scopethereof is determined by the claims that follow.

What is claimed is:
 1. A method, comprising: detecting, by a firstcomputing system, a first mobile device within a predefined proximity ofa display device; receiving profile data from the first mobile device;identifying at least one rule for selecting media content based on theprofile data; selecting, based on the at least one rule applied to theprofile data, a first item of media content of a plurality of items ofmedia content; modifying the first item of media content to include ahidden message; determining a future moment in time when the hiddenmessage will be displayed on the display device, wherein the hiddenmessage will only be displayed for a single frame at the future momentin time and will not be displayed during other frames at other momentsin time; transmitting, to the first mobile device, an indication of thedetermined future moment in time and an indication that the hiddenmessage will only be displayed at the future moment in time; outputting,at the determined future moment in time, the first item of media contentfor display on the display device, wherein the display device outputsthe hidden message only at the future moment in time and for only thesingle frame; causing the first mobile device to capture an imageincluding the display device at the determined future moment in time,such that the image includes the hidden message; identifying an avatarassociated with a user of the first mobile device; modifying the avatarbased on captured image data of the user of the first mobile device,comprising: modifying the avatar to include at least one facial featureof the user; detecting a first object that was purchased by the user ina retail environment, wherein the display device is in the retailenvironment; and modifying the avatar to include the first object;outputting the modified avatar on the display device at least at thefuture moment in time; and storing the modified avatar in a user profileof the user of the first mobile device for future use.
 2. The method ofclaim 1, wherein the profile data specifies: (i) a set of userpreferences, (ii) a set of applications stored on the first mobiledevice, (iii) a user account for each application in the set ofapplications, and (iv) biometric data captured by biometric sensors ofthe first mobile device, wherein the plurality of items of media contentcomprise: (i) live media content, (ii) locally stored media content,(iii) remotely stored media content, (iv) user-submitted media content,and (v) user-submitted media content.
 3. The method of claim 2, furthercomprising: capturing, by the first computing system, image data of theuser of the first mobile device; identifying second object in a hand ofthe user of the first mobile device; generating a graphicalrepresentation of the user and a graphical representation of the secondobject; and outputting the generated graphical representations of theuser and the second object for display on the display device.
 4. Themethod of claim 3, wherein the profile data comprises the user profileof the user of the first mobile device, the method further comprising:associating by the first computing system, the object with the userprofile of the user of the first mobile device.
 5. The method of claim4, wherein the single frame when the hidden message is displayed is of aplurality of frames of a video, wherein all frames of the plurality offrames other than the single frame do not include the hidden message,and wherein the single frame is displayed at the future moment in time.6. The method of claim 5, wherein the first item of media content isfurther selected based on a respective score computed for each of theplurality of items of media content, wherein each score is computedbased at least in part on the profile data, the biometric data, and theuser account for each application.
 7. A computer program product,comprising: a non-transitory computer-readable storage medium havingcomputer-readable program code embodied therewith, the computer-readableprogram code executable by a processor to perform an operationcomprising: detecting, by a first computing system, a first mobiledevice within a predefined proximity of a display device; receivingprofile data from the first mobile device; identifying at least one rulefor selecting media content based on the profile data; selecting, basedon the at least one rule applied to the profile data, a first item ofmedia content of a plurality of items of media content; modifying thefirst item of media content to include a hidden message; determining afuture moment in time when the hidden message will be displayed on thedisplay device, wherein the hidden message will only be displayed for asingle frame at the future moment in time and will not be displayedduring other frames at other moments in time; transmitting, to the firstmobile device, an indication of the determined future moment in time andan indication that the hidden message will only be displayed at thefuture moment in time; outputting, at the determined future moment intime, the first item of media content for display on the display device,wherein the display device outputs the hidden message only at the futuremoment in time and for only the single frame; causing the first mobiledevice to capture an image including the display device at thedetermined future moment in time, such that the image includes thehidden message; identifying an avatar associated with a user of thefirst mobile device; modifying the avatar based on captured image dataof the user of the first mobile device, comprising: modifying the avatarto include at least one facial feature of the user; detecting a firstobject that was purchased by the user in a retail environment, whereinthe display device is in the retail environment; and modifying theavatar to include the first object; outputting the modified avatar onthe display device at least at the future moment in time; and storingthe modified avatar in a user profile of the user of the first mobiledevice for future use.
 8. The computer program product of claim 7,wherein the profile data specifies: (i) a set of user preferences, (ii)a set of applications stored on the first mobile device, (iii) a useraccount for each application in the set of applications, and (iv)biometric data captured by biometric sensors of the first mobile device,wherein the plurality of items of media content comprise: (i) live mediacontent, (ii) locally stored media content, (iii) remotely stored mediacontent, (iv) user-submitted media content, and (v) user-submitted mediacontent.
 9. The computer program product of claim 8, the operationfurther comprising: capturing, by the first computing system, image dataof the user of the first mobile device; identifying second object in ahand of the user of the first mobile device; generating a graphicalrepresentation of the user and a graphical representation of the secondobject; and outputting the generated graphical representations of theuser and the second object for display on the display device.
 10. Thecomputer program product of claim 9, wherein the profile data comprisesthe user profile of the user of the first mobile device, the operationfurther comprising: associating by the first computing system, theobject with the user profile of the user of the first mobile device. 11.The computer program product of claim 10, wherein the single frame whenthe hidden message is displayed is of a plurality of frames of a video,wherein all frames of the plurality of frames other than the singleframe do not include the hidden message, and wherein the single frame isdisplayed at the future moment in time.
 12. The computer program productof claim 11, wherein the first item of media content is further selectedbased on a respective score computed for each of the plurality of itemsof media content, wherein each score is computed based at least in parton the profile data, the biometric data, and the user account for eachapplication.
 13. A system, comprising: one or more computer processors;and a memory containing a program which when executed by the processorsperforms an operation comprising: detecting, by a first computingsystem, a first mobile device within a predefined proximity of a displaydevice; receiving profile data from the first mobile device; identifyingat least one rule for selecting media content based on the profile data;selecting, based on the at least one rule applied to the profile data, afirst item of media content of a plurality of items of media content;modifying the first item of media content to include a hidden message;determining a future moment in time when the hidden message will bedisplayed on the display device, wherein the hidden message will only bedisplayed for a single frame at the future moment in time and will notbe displayed during other frames at other moments in time; transmitting,to the first mobile device, an indication of the determined futuremoment in time and an indication that the hidden message will only bedisplayed at the future moment in time; outputting, at the determinedfuture moment in time, the first item of media content for display onthe display device, wherein the display device outputs the hiddenmessage only at the future moment in time and for only the single frame;causing the first mobile device to capture an image including thedisplay device at the determined future moment in time, such that theimage includes the hidden message; identifying an avatar associated witha user of the first mobile device; modifying the avatar based oncaptured image data of the user of the first mobile device, comprising:modifying the avatar to include at least one facial feature of the user;detecting a first object that was purchased by the user in a retailenvironment, wherein the display device is in the retail environment;and modifying the avatar to include the first object; outputting themodified avatar on the display device at least at the future moment intime; and storing the modified avatar in a user profile of the user ofthe first mobile device for future use.
 14. The system of claim 13,wherein the profile data specifies: (i) a set of user preferences, (ii)a set of applications stored on the first mobile device, (iii) a useraccount for each application in the set of applications, and (iv)biometric data captured by biometric sensors of the first mobile device,wherein the plurality of items of media content comprise: (i) live mediacontent, (ii) locally stored media content, (iii) remotely stored mediacontent, (iv) user-submitted media content, and (v) user-submitted mediacontent.
 15. The system of claim 14, the operation further comprising:capturing, by the first computing system, image data of the user of thefirst mobile device; identifying second object in a hand of the user ofthe first mobile device; generating a graphical representation of theuser and a graphical representation of the second object; and outputtingthe generated graphical representations of the user and the secondobject for display on the display device.
 16. The system of claim 15,wherein the profile data comprises the user profile of the user of thefirst mobile device, the operation further comprising: associating bythe first computing system, the object with the user profile of the userof the first mobile device.
 17. The system of claim 16, wherein thesingle frame when the hidden message is displayed is of a plurality offrames of a video, wherein all frames of the plurality of frames otherthan the single frame do not include the hidden message, and wherein thesingle frame is displayed at the future moment in time.
 18. The systemof claim 17, wherein the first item of media content is further selectedbased on a respective score computed for each of the plurality of itemsof media content, wherein each score is computed based at least in parton the profile data, the biometric data, and the user account for eachapplication.